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ABSTRACT 


This thesis investigates the quality of decisions made 
as a function of the method of representing information and 
the amount of information presented. A software-controlled 
sequential decision experiment was conducted. A variation 
of the game of chess was used as a low-level Surrogate for 
battlefield scenarios. The object was to determine if the 
amount and method of representing information significantly 
affected the quality of the decisions made. 

The analysis of the collected data indicates that 
several factors affected the measure of effectiveness. The 
Situation or scenario, the experience of the subject, the 
way information is represented, and the amount faye 
information all affect the quality of decisions made. 
Multicolored displays of information helped novice decision 


makers perform better than experienced decision makers. 
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I. INTRODUCTION 


A. BACKGROUND 

One of the most important elements of Command, Control, 
and Communications (c3) is information handling. Command 
and control can better be exercised when the essential 
information is provided to the end user, the decision maker, 
in the form needed and the decisions made can be effectively 
disseminated in a quickly comprehensible form and in a 
timely manner. In a dynamic battlefield environment, attack 
Warning and assessment must be timely and they must _ be 
provided ina form which facilitates quick understanding. 
The information must be sufficient and brief. The feedback, 
in the form of decisions made, must be received by the 
tasked forces ina quickly understood form with minimum 
delay. 

Very little investigation has been conducted to 
determine the efrveadcy "Of methods of representing 
information. Very few studies have looked at the effect of 
different amounts of information on the quality of decisions 
made, Therefore, aside from the use of automation, our 
command information and briefing centers have hardly changed 
over the years. Today, for the most part, we just have 
bigger, automated, displays with which to present more 


information in traditional forms. Computers have allowed us 


Jha 


to increase the amount and speed of display. With the vase 
amounts of information available today, and the emphasis on 
timely, qualitative decision making in crisis environments, 
it is imperative that we find efficient and effective ways 
to represent information and to determine the essential 
amount of information needed to make quality decisions. 
Commanders know what information they want to make 
guality decisions. CUEGenE strategic and tact reau 
battlefield commanders can have information concerning their 
area of operations in near real-time. The modern command 
information centers and briefing rooms have large screens 
and desktop computer terminals and monitors to display the 
information requested by the commander. The senior 
commander wants and gets information in the form with which 
he or she is most comfortable. The information necessary for 
a quality decision may be present on a display, but the 
representation of the information may not enable a quality 
decision in a timely manner. And, the amount of information 
presented may be more than is necessary to make a quality 
decision. To have the right amount of information, in the 
right form, and at the right time in a dynamic battler 
environment can mean the difference between an effective and 


an ineffectual decision maker. 


EZ 


Reese ol UDL ES 

Miller [Ref. -1] investigated the channel capacity for 
absolute judgement and immediate memory of observers. 
Channel capacity, as it is used here, means the maximum 
amount of information a person can comprehend, remember, and 
employ when tested. Miller's study purports a channel 
capacity increase as more variables or dimensions are added 
be a wdisplay. The study proposes a channel capacity of 
seven items, give or take two items for one-dimensional 
Seaimuli. By recoding information with mnemonic aids, 
association, and such, the total amount of information a 
person can deal with can be increased. 

Streufert and Streufert [Ref. 2] studied risk taking in 
decision making as it relates to an amount of information in 
a given time. In their experiment, civilian decision makers 
acted as commanders ina simulated invasion of a mythical 
island. Their experiment showed that the commanders took 
more risks and made aggressive offensive action decisions 
when increased time was spent in decision making. The study 
also substantiated earlier findings that an optimal load of 
information is attained when ten to twelve independent items 
of information are received each half-hour. At this rate of 
presentation of information, the greatest risk taking was 
observed. 

Hayes [Ref. 3], using simulated military problems, 


researched the data processing limits of Navy enlisted 
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decision makers. He presented information in alphanumeric 
matrices. - Hayes measured both decision quality and decision 
time. He found that more than four individual pieces of 
information decreased the efficiency of decision making. In 
particular, he observed that unlimited decision time did not 
increase decision quality when increased information was 
provided. With a limited time for decision making, the 
quality of decisions decreased as the amount of information 
presented increased. 

Vincino and Ringel [Ref. 4] evaluated the efficacy of 
Graphic versus alphanumeric information displays. They used 
black and white transparencies to present battlefield 
Situations to subjects who had a low level of military 
experience and sophistication. Although they timed their 
Subjects, they allowed their subjects to study each initial 
Situation display until the subject indicated a readiness to 
COnemnue: The subjects were then shown a second slide 
depicting one or more battlefield changes in each sector. 
Their conclusion was that there was no apparent difference 
in quality of decisions made, speed with which decisions 
were made, or the confidence of the decisions made between 


the graphic and alphanumeric presentations. 


C. EXPERIMENT FOUNDATION 
An experiment conducted by O'Bryant and Risney [Ref. 5] 


formed the foundation for this thesis. This thesis effort 
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used a slightly modified reproduction of the O'Bryant and 
Risney experiment to investigate the effect of different 
representations of information and amounts of information on 
decisions made. 

Several surrogates for combat have been developed and 
used to teach, SEuady, evaluate, test, and practice 
sequential conflict strategy. A computerized, controllable, 
reputable war game simulates battlefield conflicts. ihae 
facilitates data gathering. And, it enables repetitive 
presentation of different representations of the same 
information. 

O'Bryant and Risney conducted an investigation into the 
value of intelligence uSing simulated battlefield scenarios. 
They used a computerized variation of chess with 
alphanumeric displays as their war gaming model. Chess 
requires sequential decision making and is the oldest known 
War game in western civilization. The Joint Chiefs of Staff 
(JCS) Joint War Gaming Manual classifies chess as a research 
type war game [Ref. 6]. 

In their experiment, the chessboard was duplicated 
through the use of a cathode ray tube (CRT) display and a 
computer. Their subjects, mid-level United States (US) 
Military officers, each played four war games. In each 
surrogate war, the subjects were presented a different 
battlefield situation anda different level (amount) of 


information. The levels of information pertained to 


ils: 


friendly and enemy force positions, dispositions, sStrengeney 
and vulnerabilities. The objective was to depict 
Simulated battlefield situations and evaluate the quality of 
decisions made as related to the level of information 
presented. The measure of effectiveness (MOE) or measure of 
decision quality was a game score. The score was based on 
the remaining available forces for both sides at the 
conclusions of simulated conflicts. The score was a 
quantitative measure of which side had the advantage and the 
magnitude of the advantage. O'Bryant and Risney attempted 
to show that the decision maker's effectiveness (game score) 
waS not a monotone function of the amount of information 
presented. Instead, they believed that: given a particular 
method of presenting information, the relationship between 
effectiveness and quantity of information was meno@enc 
increaSing up to a certain information level, beyond which 
effectiveness would decrease indicating a condition of 
information overload. Their experiment confirmed this 
hypothesis of the existence of information overload by 
showing that decision makers in a chess’ game were 
Significantly more effective in some scenarios with less 
IN-OrMataon:- 

The information level which most closely resembled the 
normal view of the chessboard was the best experimental 
information level among four levels OF information 


presented. They thought they could ,attribute thatseeoeee 
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idea that the information was in a form most familiar to the 
end users. When they presented the display containing the 
greatest amount of information, they felt the amount of 
information could not be effectively used. Two reasons’ for 
the subjects having failed to use the information were 
proposed; 1) the ee of representing the information did 
not facilitate quick comprehension of the information 
provided, or 2) there simply could have been too much 
information to digest and use in the allotted time. They 
reasoned that there is some quantity of information that is 
optimal for each method of representation. They considered 
that there exists some amount of data that is excessive 
regardless of the method of representing the information. 
One area this study investigates is the possibility that 
representing the same information levels in a graphic form 
would remove the affect of the information overload found 


in their experiment. 


D. SCOPE 

This is a study to determine if the way information is 
displayed and the amount of information presented adds to or 
detracts from a person's ability to make quality decisions. 
Ke) study the effect of different representations of 
information on decisions made, this study used graphic 
displays in place of the alphanumeric displays used in the 


O'Bryant and Risney experiment. The graphic displays 


ey 


represented information with iconic chess symbols. The 
graphic display experiment was conducted in @twospnacecs One 
phase used color surrogate battlefield displays and the 
other phase used monochrome-green surrogate battlefield 
displays. 

This study investigated the effect ‘ene three 
representations of information on the quality of decisions 
made. One objective of the study was to determine if one 
of the following three ways of representing information best 
facilitates quality decision making: alphanumeric display, 
color graphic display, or monochrome-green graphic display. 
The study also looked at the effect of four different 
amounts of information on the quality of decisions made. The 
objective here was to determine if there was such a thing 
aS too MUCGheintormacien, Too much information, based on 
information overload theory, results ina decrease in the 
quality of the decision(s) made. The score for each game, 
the measure of the quality of decisions made, was the MOE 
for this experiment. The scores were derived the same way 
in this experiment as they were in the O'Bryant and Risney 
experiment. 

Except for the ways of representing information and 
interacting with displays, the experiments were replicates. 
As a result of the graphic experiment design, the subjects 
used a mouse and tablet to record and disseminate their 


decisions. The subjects in the O'Bryant and Risney 
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experiment had used a keyboard to interface with their 
displays. 

With the game of chess, each piece can be considered as 
a maneuver element with certain detection and engagement 
capabilities. It may help to envision this concept if you 
think of each piece as having radar coverage and field of 
fire commensurate with itsS maneuver capability. The game of 
chess has force attrition due to engagements and enables 
limited resupply. Limited resupply is accomplished when a 
Pawn reaches the chessboard back row (resupply point) of the 
opposing force and an exchange is made for a much more 
highly maneuverable and sophisticated combat unit. 

At the beginning of each chess game, the subjects were 
told that force numbers and strengths were fairly equal for 
both sides of the board. The four leveis of information 
always displayed all of the friendly forces. Two of the 
levels displayed some of the enemy forces and two of the 
levels displayed alli of the enemy forces. Three of the 
levels identified enemy forces which were susceptible to 
capture. And, two of the levels identified safe areas for 
Friendly forces. The alphanumeric displays depicted 
friendly forces with the preceding character of W, for 
White, and the enemy forces with the preceding character of 
Bye for Black. The color graphics displayed blue iconic 
Figures for friendly forces and red iconic figures for enemy 


forces. For the monochrome-green graphics displays, there 
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was no shade differentiation between the friendly and enemy 
ECON Me ErouULesr Therefore, after receiving an initial 
"report" on which forces were. friendly and which were enemy, 
the subjects in the monochrome-green phase had to mentally 
keep track of their own forces. 

Level 1, the lowest level of information, presented the 
friendly chess pieces, and only those enemy chess pieces 
which could be captured by the friendly pieces on the 
subject's Gur nenit move. This level of information 
represents the battlefield when the commander f i9gsSie 
skirmishes with the enemy. Intelligence reports indicated 
that the opposing forces, all or several of which were not 
visible, were comparable in strength. Now, the commander 
receives reports of actual enemy contact from reconnaissance 
patrols. The commander can engage only one enemy element at 
a time, withdraw, or maneuver his or her forces to protect 
and add depth to one of the friendly leading elements. This 
1S a precarious Situation because an unseen enemy may be 
poised for a strike against friendly forces or as reserve to 
an endangered enemy element. This scenario simulates 
fighting in a guerrilla war. 

Level 2 presented all the friendly pieces, those enemy 
pieces which could be captured, and safe areas. Again, 
intelligence reports indicated the opposing forces were 
comparable in numbers and strength, and all, or a sizable 


portion of the enemy force, would not be visible. Safe 
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areas are positions safe from enemy attack. In the graphics 
eee ment, safe areas were identified by means of a little 
box in the lower left corner of an appropriate chessboard 
square. A safe square could be an unoccupied square or a 
square currently occupied by a friendly or enemy piece. The 
annotation of a safe square meant a friendly piece on that 
square would be safe from attack by an enemy piece on the 
enemy's next move. This type of scenario represents a 
battlefield situation where there are limited intelligence 
reports along with forward element contact reports. In this 
case, intelligence reports the enemy elements which can not 
be supported if attacked, the friendly elements which are 
free from attack, and safe areas for friendly forces if they 
could move into those positions. Because the decision maker 
knew which of his or her forces were in jeopardy, the 
guality of the decision made under these conditions was 
better than decisions made under the conditions of least 
MmEeormation. 

Level 3 provided the normal view of the chessboard. 
This amount of information was found to be best for the 
alphanumeric experiment and for the color phase of the 
Graphic experiment. This level can be equated to complete 
knowledge of enemy elements and numbers in the the 
battlefield area, but having no indication of probable enemy 
intentions. Except IEEE the decision maker's own 


understanding of and experience with similar GOnEILCE 
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Situations, the only information available to the subject 
wee the raw data on friendly and enemy force element 
locations. This level most relies on the decision maker's 
ability to use raw data, know enemy element capabilities, 
contemplate enemy intentions, and orchestrate friendly 
forces in a conflict environment. 

Level 4 displayed the most information. This was the 
best level of information in the monochrome experiment. It 
resulted in the best scores. The display showed all the 
pieces, annotated the safe positions as was done with level 
two, and identified enemy pieces which were susceptible to 
capture. The vulnerable enemy pieces were identified in the 
graphics experiment by a little box in the lower right 
corner of each appropriate chessboard square. This level of 
information can be equated to multi-sensor intelligence 
information on the battlefield situation. The enemy's 
intentions are not actually known, but probable enemy 
courses of action are made known to the friendly force 
commander. Based On enemy capabilities, vulnerable, 
unsupported enemy forces, endangered friendly forces and 
safe areas are known. 

For this experiment, five hypotheses were formulated: 


1. There is no difference in performance based on the 
level of information presented. 


2. There is no difference in performance based on the 
Situation or scenario. 


Ze 


Sa lL nere is no difference in performance based on the 
sequence of events, trial order. 


4. There is no difference in performance based on the 
experience of the subject. 


5. There is no difference in performance based on how the 
information is represented. 

BE. APPROACH 

The approach to this investigation followed standard 
experimentation practices. A problem was identified. The 
problem is twofold. It is identified as the way information 
is represented and the amount of information presented to 
decision makers. The problem was bounded by using a 
Variation of the game of chess as a Surrogate for sequential 
decision making Cont act Situations, representing 
"battlefield" displays in more than one way, and providing 
four levels of information to decision makers. 

Chapter II discusses the experiment used as the baseline 
for this experiment. 

tneechnapter IIL, the experiment design, subjects, 
apparatus and materials, and procedures are discussed. 

Chapter IV examines the captured data and explains’ the 
tools used for analysis. 

The experiment conclusions and recommendations are 


presented in Chapter V. 
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IT. BAPERIMENT BASERGNG 


A. OVERVIEW 

O'Bryant and Risney [Ref. 5] automated their experiment 
to facilitate control and data collection. They designed 
and developed a computer program to COME FOU the 
communication between, andthe displays for, a subject and 
the game umpire. The program also timed each move of a 
Subject, checked for legal moves, and collected and wrote 
data saves to a file for future analysis. The program was 
Written in FORTRAN 77 and consists of 25 subroutines in 
three files. The software resides in and runs on a Digital 
Equipment Corporation (DEC) VAX 11/780 minicomputer system 
at the Naval Postgraduate School (NPS) Wargaming Analysis 
and Research Laboratory (WAR Lab). The program uses DEC VAX 
11/780 Systems Programming Calls. 

Their experiment used thirty-one US military officers as 
participants. Every subject played four chess’ surrogate 
War games. Different opening board (about ten moves into a 
game) set ups were used for each game to represent different 
Situations. Each game presented a different amount of 
Iinfermat lon: 

Their experiment measured the quality of decisions made 
under various levels of information. At the end of each 


game, a score (MOE) was derived by a computerized chess 
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game. With the computerized game, they evaluated the 
opening board and determined each end-game score. These 
derived values were based on a composite of the appropriate 
game board's material and positional strengths. The end- 
game score for each game was adjusted to reflect the opening 
game set up and any penalty points accrued by the subject. 
Their analysis suggests a relationship between the 
amount of intelligence provided and a decision-maker's 
performance. They concluded that there is an information 
level such that more or less information resulted in a 
decrease in performance. Their experimental analysis 
Supports the concept of information overload. thas 
experiment investigates the possibility that their 
information overload was really a factor of the method of 


presentation. 


B. SCENARIOS 

O'Bryant and Risney used four scenarios in their 
experiment. Since successive games could have more or less 
information than the current game, each game presented a 
different scenario. The subjects were therefore ovrecluded 
from memorizing a chessboard set up and using that knowledge 
to assist in playing a subsequent game which may have 
presented less information. Figures II-l through II-4 show 
the scenarios using alphabetic format. The chess pieces are 


depicted by two alpha characters. Beopewe in the first 
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character position denotes a Black or White piece 
respectively. The second character uses P for Pawn, 8B for 
Bishop, R for Rook, N for Knight, QO for Queen, and K foam 
Kang. The figures show example chessboard displays from 
their experiment as they were depicted in alphanumerreomaas 
the monitor. For the O'Bryant and Risney experiment, the 
subjects used standard chess notation and keyboard entry to 


make their moves. 


-- BR BB BQ BR ** BK ** BR ** -- ** -- BR BK s+ 
** BP BP -- ** BP BB BP BP BP ** BN BB BP BP -- 
BP ** BN BP BP BN BP ** -- BQ -- ** BB BN -- BP 
R*¥ -Se WK OR XK 2 Sa ** ~-~ BD BP ** -— *¥* ~H— 
TR ae 5 WP WP WP “x a. ORK ue ee eee WP -- eS WB 
** WP WN -- WB WP ** -- ** -- WP WB ** WN ** WP 
WP ** -- WQ WN ** WP WP WP WP -- WN -- WP WP ** 
** -- WR -- WK WB ** WR WR -- ** WO WR -- WK -- 
Figure II-l Figure II-2 
Initial Set Up A Inltlal See Us ws 
-- ** -- BOQ -- BR BK ** BR ** BB BK -- BB -- BR 
** -- BP -- BN BP BB BP BP -- ** -- ** BP BP BP 
SS Eee BP -- BN BP * * a ee BP oe ee BN -- ** 
** BP ** WP BP -- WB -- ** WN Rk ae *£€*¥ 2S Ree 
-—- WP --—- ** wp ** BR ** aw ** awa ** wa * ¥ ee 
*¥*e ~.— BR =-— ** WN ** -= ke oe WN @— **¥ aoe **F —=— 
-- ** WP WQ WB WP WP WP WP WP -- ** WP WP WP WP 
** -- ** WR ** WR WK -- WR -- ** -- WK WB ** WR 
Figure II-3 Figure [I-4 
Inttval=set se. Cc Initial Set Up D 


oF INFORMATION LEVELS 
Four different games with differing information levels 
were played by each subject. Figure JI-5 depicts tne 


information levels used in the experiments in graphic form. 
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The sequential numbers for the information levels have no 
real meaning, they are non-quantitative. Level one is for 
the least amount of information presentation, level two 
represents the presentation of some information, level 
three is for the normal view of the chessboard, and level 
four represents the presentation of the normal view of the 
chessboard plus some additional information. 


Information 
Level 


4 i es ee RR KK KAR KK ERE KE ERE AG 


‘I I 


3 q RR RRKKKKREKEKE REKEREKKKEEEKEKEY 
{ {I 
2 RR EKKKEREKERERERKEEREEEKERERRERERERKEKEKERS qj 
{] | 
I RRR KKKRKERKEKEKKEKKEKKKEKEKES qj 
| "laden aac ii i ee Si ee at ce | 
Friendly Vulnerable Safe Enemy 
Pieces Enemy Positions Pieces 
Pieces (Specified) 
(Specified) 


Information Displayed 


Figure II-5 
Information Level Versus Information Displayed 

D. COLLECTED DATA 

Data were automatically collected during the conduct of 
the experiments [Figure II-6]. The collected data consist 
Sue csceveral items of interest. The monitor displays for the 
First and tenth moves were saved in alphabetic format. The 
First four lines of the headings for each of these 


chessboard depictions is the same. The subject's name is 


isi 


PLAYERS NAME IS: XXXxXxX - 
EXPERZENCE DEV Gi ore 
MOVE # = l 

TYPE OF SCENARIO = 1 
INITIAL BOARD SET UP = B 


BR TN eas KK Se BR BK *x* 

BP BP ** BN BB BP BP -- 

-- BQ -- ** BB BN --— BP 

KX o_o BP BP 6x 2 eS] 

a OK ae WP ao aa WB 

** —- WP WB ** WN ** WP 

WP WP -- WN -- WP WP ** 

WR -- ** WQ WR -- '\KK -- 

. R/QR1-QN1 TIME 
Q/QN3-QR4 

Q/Q1-K2 TIME = 25.4 SECONDS 
Q/QR4*P/QR7 

P/KN2-KN3 TIME 
B/K2-Q3 

. O/K2-Q1 TIME 
P/QB4*P/Q5 

N/KB3*P/Q4 TIME = 69.6 SECONDS 
B/K3*P/KR6 

Q/Q1-QB2 TIME = 59.1 SECONDS 
R/QR1-Kl 

B/Q3-KR7 CHECK TIME = 41.8 SECONDS 
N/KB3*B/KR2 EVALUATION CODE = 0589 BL 
K/KNI1-KR2 TIME = 49.9 SECONDS 
B/KR6-KN5 EVALUATION CODE = 0582 BL 
P/KB2-KB3 TIME = 34.9 SECONDS 
B/KN5-K3 


Li2. 22 Skeonrs 


127.5 SECONDS 


76.0 SECONDS 


WSEWe2Wdandeandawdneandawawd = 


PLAYERS NAME IS: XXXXX 
EXPERIENCE LEVERS IS: ))5 
MOVE # = 10 

TYPE OF SCENARIO =a 
INITIAL BOARD SET UP = B 
EVALUATION CODE = 0568 BL 


So ee eas ee BR BR BK *x* 
BPeBP "eb NeA Bp pewen 
-- ** —- BB BB ** ——- BP 
kx ——. *X BP xx ere 
re ee Mae WN -- Le Se WB 
*#x -- WP -- ** WP WP -- 
BQ WP WQ WN -- ** -- WK 
** WR kx =] WR -- xx Ss 


Figure II-6 
Example of Captured Data 
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the first entry (the example uses XXXXX). An experience 
level with A = never played, B = novice player, C = frequent 
player, and D = tournament player is the second entry. The 


move number, 1 or 10, is the next entry. The type of 


scenario, amount of information, where 1 = normal view, 3 
least amount of information, 5 = some information, and 6 = 
most amount of information is the fourth entry. The initial 
Board set up of WY, B, C, of D is the fifth and last entry in 
the lead header. The tenth move header includes an 
evaluation code. All moves were saved. The moves are 
preceded by aW or B for White or Black moves. An example 
move is R/QR1-QN1; meaning Rook at Queen's Rookl moves’ to 
Queen's Knightl. The "*" means takes or captures. ie 
addition, the amount of time the player took to make his or 
her move, anda hexadecimal evaluation code for the eight, 
ninth, and tenth moves were saved. A BL or WH after the 
evaluation code stands for Black or White advantage at that 
Point. All the output for the experiments resides in the 


WAR Lab computer system in the CHESS directory. 


E. SUMMARY 

This chapter reviewed the experiment used asthe 
baseline for this study. The programs O'Bryant and Risney 
developed to control their experiment, the subjects’ they 
used, their MOE, and their conclusions were discussed and an 


example of the captured raw data was presented. 


ao 


Ili. EXPERIMENT METHODOERCS 


Pea LUNERODUCT LON 

This chapter presents the methodology of the graphic 
display experiment. The methodology includes the design, 
a description of the subjects, apparatus and materials used, 


and the procedure for conducting the experiment. 


B. EXPERIMENT DESIGN 
l. Overview 

Because this experiment was a close copy of a prior 
experiment in the same computer laboratory facility, many of 
the necessary apparatus, materials, and software were 
readily available or appropriate with slight modification. 

The identified factors which could affect the value 
of the MOE were alphanumeric versus graphic displays and 
color versus monochromatic attributes, level of information 
provided, opening chessboard, game order, andthe chess 
playing experience of each participant. This experiment was 
a highly structured, carefully controlled evaluation to 
facilitate formal numerical analysis and replication for 
further investigation. 

The dependent variable for the experiment, the score 
(MOE), was a quantitative measure reflecting the quality of 


decisions made. The score was derived by the proprietary 
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algorithm of the selected computerized challenger. A score 
was saved after move eight, nine and ten. The scores saved 
for moves eight and nine were for contingency purposes. The 
score at the end of move ten was used as the unadjusted game 
score. Each score was derived from the composite of 
material and positional board strengths for the remaining 
chessboard pieces. A positive score indicated the degree to 
Which the subject was ahead and a negative score indicated 
the degree to which the computerized challenger was ahead. 
All scores were negative by end-game. 

The independent variables included the method used 
to represent the information--graphical in color or in 
monochrome-green, or by alphanumeric displays. They include 
also the ordering in which the information was presented; 
the experience level of the participants; the scenario or 
soe, UD; and the amount of information provided. The 
mathematical model for the experiment is a general linear 
model. 

The experiment was conducted in the NPS WAR. Lab with 
very few outside materials. A DEC VAX 11/780 minicomputer 
system and typical computer facility equipment consisting of 
terminals, keyboards, and high resolution graphics display 
monitors with mouse and tablet interface were used. The 
Outside materials consisted of a Fidelity Electronics, 
Limited, Super Sensory "9" Chess Challenger, a questionnaire 


[Appendix D], and a standard chess set. 


oe 


2. Design 
For any experiment, one first identifies a problem, 
narrows the problem to a workable level, formulates 
hypotheses and then sets about the task of determining an 
appropriate way to test the hypotheses. 
The mathematical -model for the MOE and factors of 


interest are: 


We fb (Cs ‘- ie On sa Ceci 


where: 

Y = MOE 

us = mean of population, common effect in observations 

QQ. = information level effect (i= 1, 273, (cme 

B, = scenario effect {j= lz, ole 

Y,. = trial number effect (k= 1) 2) 3pmogre 

0, = experience level effect (l= 1, 2, or 3) 

p = experiment presentation (m= l-color, Z-moncochrmomer 

or 3-alphanumeric) 
E> 2 random, unknown or uncontrolled error 
A master schedule [Figure III-l] was used to assist 

in the conduct of the experiment. One master schedule was 


completed for the color phase, and a Separate master 
schedule was completed for the monochrome phase of the 
graphic experiment. When a subject participated in the WAR 
Lab, the master schedules were checked to determine the 


appropriate phase, color or monochrome, the trial (game), 


Sa 


Experiment Schedule 


Subject Pxpuelc Sseore [5 Ssceore £S Scere IS Score 
ule TA 5B 36 6D 
Ds ~ SA ~ IB S2\10) 6C 
a = 3A ike 5B 6D 
a. = jh) eC Gee SDeun 6 SB 
5. = ee 5D 6B 3¢ | 
6. /_ SA 1D ~ 6C - 3B 
i 7 3B 1s 6C 5D°”.~—COS™s 
8. a 6B 1A 3D 5c 
9. ~ 1B BC SA 6D 
nO . = 5B 3C 1D 6A 
ide - 3B 5D ya 6C 
2. = 6B 5D 1c 3A 
eee - Ife 3A 6B 5D 
kA. a SC - 3A 6D ie 
1_Sy > 3C 5B 6A 1D 
16. - 6C 5B 3D 1 a 
7. _ Ie 6D 5A 3B 
18. “ 5G 6D 1B 3A 
19. = 3D 6A 1B 5C — 
20. ¥ 6D 3A ine 5B 
Deals " 1D ' 6B 3A 5C 
22 . ~ 5D 6B ae TA 
23. a 3D 6C SA 1B 
BA, = 6D SKE 5B pA 
25 a 1A 5B SC 6D 
26 Sees Oe 5 aaa Ae ue OC 
Legend: 
PRO Experience Leyel (1, 2, 3, of 74) 
IS = Information Level Menu Number (1, 3, 5, or 6) 


Scenario Character (A, B, C, or D) 
Figure III-l 
Master Schedule 
the information level, and the scenario (initial board set 


up) to be used. The completed schedule contained th 


D 


subject's name, experience level, order of amount of 
information/scenario combinations, and scores. Subjects were 


randomly matched to a subject number. The only constraint 


cS: 


was that of having an equal number of subjects in each of 
the two phases. 

The master schedule was developed pseudo-randomly. 
Et was based on the desired use of four different 
information levels and four different scenarios in four 
Eras. Because there were four information levels to 
present to each subject, that meant there were four items 
(information levels) taken four at a time (four trials per 
subject) for twenty-four permutations. A minimum of twenty- 
four subjects were required to play the different possible 
lineal orders of the different levels of information in four 
games. Because there were four different scenarios, this 
also meant four items (scenarios) taken four at a time (four 
trials per subject) for twenty-four permutations. 

There was no attempt made to compute all the 
possible lineal orders for four trials of four different 
information levels and four different scenarios. Random 
selection of the trial combinations was accomplished by 
overlaying the scenario vdermutation schema on the 
information level permutation schema. This ensured all 
information level lineal orders were used and that each 
subject played a different scenario for each of the four 
Paes), 

The four levels of information were selected from a 
menu [Figure III-2] which was displayed on the umpire's game 


terminal. Information levels 1, 3, 5 and 6 were used for 
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TO INITIALIZE THIS PROGRAM SELECT THE TYPE 
OF BOARD DISPLAY FOR THE PLAYER. 


eae, DISPEAYSENTIRG BOARD 

3.-- DISPLAY WHITE PIECES AND BLACK'S PIECES 
RAAT CANTBERATTACKED 

5.-~ DISPLAY WHITE PIECES, WHITE SAFE MOVES, 
AND BLACK PIECES THAT CAN BE ATTACKED 


6.-- DISPLAY ENTIRE BOARD, BLACK PIECES THAT 
CAN BE ATTACKED, AND WHITE SAFE MOVES 


Figure IfI-2 
Information Level Selection Menu 

the experiment. The numbers were used by the game umpire 
to provide the displays of the appropriate information level 
for each game. Selection of number 3 presented the least 
amount of information, number 5 presented some additional 
information, number 1 provided more information and number 6 
provided the most amount of information to the subject. On 
the data sheets, [Tables III-l, III-2, and III-3], 1 = 
least amount of information, 2 = some information, 3 = more 
information and 4 = most information. 

The experiment was designed specifically to 
Simulate tactical military situations. The information 
levels of the experiment simulated battlefield situations. 
Consider that each chess piece has certain target 
acquisition, radar coverage, maneuver, and target 
engagement, strike, capabilities. For example, some 
Challenger pieces appeared or disappeared as they moved in 
Or out of friendly radar coverage or fields of fire. This 


was tne case with information levels 1 and 2, where the 
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enemy pieces appeared and disappeared during the game. A 
Similar thing happened in level 4 where annotataene 
identifying vulnerable Challenger pieces appeared or 
disappeared with each move. 

Four different initial board set ups were) selemaas 
[Figures 211-3 througn fri—oue On the data sheets, 1 = 
Scenario A, 2 = Scenario B, 3 = Scenario C and 4 = Scenario 
De 

To simulate timely decision-making, subjects were 
allowed two minutes per move prior to being assessed a point 
penalty. For every minute, or fraction of a minute, past 
the deadline, a penalty was assessed. Each penalty was 
equal to the material value of one pawn (256 points).This 
restriction was used to eliminate the possibility of slow 
play due to fatigue. To assist participants, the time taken 
for a subject's first move for each game was not subject to 
penalty. Therefore, the initial chessboard display could be 
adequately studied. 

The opening chessboard presentations were 
approximately ten moves into a game. By uSing these set 
ups, the number of moves required for a subject to confront 
a challenger or be confronted was greatly reduced. 

The MOE score was obtained after the tenth move 
initiated by the subject (game move twenty). This allowed 
Maneuvering and yet decreased the possibility of checkmate. 


Every game played to conclusion would have resulted in a 
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Figure III-3 
Initiaw Grapnic Scenario A 
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Figure III-4 
Initial Graphic Scenario B 
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Figure III-5 
Initial Graphic Scenario C 
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Figure III-6 
Initial Graphic Scenario D 
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plus checkmate score, if the subject won, or a minus 
checkmate “score if the Seance won. An objective was to 
evaluate affects of levels of information and information 
representations on measurable subject performance. This 
could not have been done if all the scores were of the same 
absolute value. Every game not already in checkmate was 
played for at least thirteen moves. The subjects did not 
know a game was actually over after move ten. 
3. Subjects 

The experiment was conducted in the NPS WAR Lab, a 
secure computer facility. Access to the WAR Lab required 
the completion OF a current favorable background 
investigation for a national security clearance. This 
precluded foreign national students from taking part. Many 
of these may have been quite knowledgeable in chess. Almost 
all the participants were NPS students in Command, Control, 
and Communications or Space Systems Operations curricula. 
The experiment samples totaled fifty-two subjects. Twenty- 
Six subjects for the color phase and twenty-six subjects for 
the monochrome phase. There were four civilians. Other 
than one Air Force Lieutenant Colonel and one Air Force 
Lieutenant (Captain selectee), the military ovarticipants 
were all senior 03s or 04s. All military participants had 
recent operational experience. There were ten Army, twenty- 


Six Navy, ten Air Force and two Marine participants. All of 
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the participants had normal OF correctedMicr ice ossan No 
participants were color sel. 

Using the experience level menu descriptions [Figure 
III-7] which were displayed on the player terminal, eight 
Subjects rated themselves as never having played cness 
before. Forty subjects rated themselves as novice chess 
players. Four subjects rated themselves as having played 
chess frequently. No subjects rated themselves as 


tournament chess players. 


PLEASE ENTER YOUR EXPERIENCE LEVEL 


.-- NEVER HAVE PLAYED CHESS So5 0.0 
A NOVICE CHESS PLAYER 

~--- PLAY CHESS FREQUEN ER 

° TOURNAMENT CHESS PLAYER 


9QW0 Y 
! 
: 


Figure III-7 
Experience Level Selection Menu 

Participants of the graphic display experiment did 
not have to know chess notation or basic chess movement 
Statements such as Q/Q1-QB2 meaning advance Queen at (/) 
Queenl to (-) Queen's Bishop2 position, or N/Q7*Q/QN6 where 
N stands for Knight and an "*" means "to take", to make 
moves. Nevertheless, participants should have had a working 
knowledge of the game of chess to fully and effectively 
participate in the experiment. To offset this confounding 
factor, the designated sample population was informed of the 


experiment and their expected contribution one academic 
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quarter before the experiment. The subjects Peeaived a 
briefing and a handout [Appendix B] approximately one month 
Beror £€O their expected participation. A standard chess 
game was placed in a common-user area so the participant's 
could familiarize themselves with the game of chess, or 
pecgaim any lost proficiency by practicing. 
4. Apparatus, Software and Questionnaire 
a. Apparatus 

The apparatus for the experiment were located in 
Ingersoll Hall, room IN-157, the NPS WAR Lab. The typical 
lab configuration proved quite satisfactory for the 
experiment. Lab partitions and sliding curtains were used 
to enclose the experiment area, This arrangement allowed 
the umpire and player to converse and to carry out the 
experiment with minimal outside distractions. The umpire 
positioned himself and his equipment so he could observe the 
display and play of the subjects. The subjects could not 
see the umpire's display. 

The initial interface with the experiment 
software programs was by means of the DEC VT100 or DEC VT102 
Video display terminals and keyboards. The game umpire and 
player each used a terminal to log on the system and call 
their respective programs and subsequent displays. For the 
player, the display terminal monitor and keyboard were used 
Only to log on the VAX system, start each trial, and sign 


off the system at the conclusion of the experiment. The 
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‘umpire used the terminal monitor and keyboard more 
extensively. The umpire had to control the conduct of the 
experiment and scoring by keyboard entry. 

Both the umpire and the player used the graphics 
display and graphics equipment interface devices. The 
graphics displays were on RAMTEK GM859C high resolution 
color monitor screens using 9460 controllers. All chess 
moves were made using a mouse and tablet interface method. 


To provide a consistent challenger for every 


game, a computerized chess game was used by the 
experimenter. A subject was not pitted against another 
Subject. Each Subject's challenger was a US Chess 


Federation rated computerized chess game. The computer had 
perfect knowledge and knew the poSition of every piece 
during every move of every game. The computerized chess 
game formalized the scoring or measure of the performance 
process. In recent years, several portable computerized 
chess games have been rated by the US Chess Federation. A 
nighly rated computerized chess game, the Fidelity 
Electronics Super Sensory "9" Chess Challenger, was used by 
the umpire. The Chess Challenger had been used for the 
alphanumeric experiment of O'’Bryant and Risney. By uSing 
the Chess Challenger, the subjects for the color and 
monochrome phases were provided the same level of play as 
the subjects for the alphanumeric experiment. The game 


scores were derived from the same artificial intelligence 
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algorithm. This facilitated score comparisons between the 
graphic and alphanumeric experiments. The Chess Challenger 
can provide nine playing strengths from training to 
tournament level. The playing strength is dependent on the 
amount of time available for the chess program to "think". 
Training level one was used for the experiments. At level 
one, the Chess Challenger had an average response time of 
five seconds for each of its moves. Level one seemed 
reasonable because the Chess Challenger always had perfect 
information and the human element, regardless of the 
information level, was penalized if any turn was not 
completed within two minutes. Pilot trials for the graphics 
experiment indicated that level one was adequate. The 
"challenger" (opponent in the experiment) is rated at 
approximately 1825--1850 by the US Chess Federation. 
(Grandmaster rating is equal to 2600 and above. Senior 
Master rating is 2400 to 2599. Master rating is 2200 to 
Zoe. ExXpert rating is 2000 to 2199. Class A rating is 1800 
to 1999. Class B rating is 1600 to 1799. And, Class C 
rating is below 1600 points.) The "challenger” equates toa 
Class A player [Ref. 7]. 

At level one, for each move, the Chess 
Challenger would think about and store up to nine 
anticipated best line of play half-moves. The first move is 
a countermeasure to predicted move of the subject. The 


second is the subject's anticipated countermeasure, and so 
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one The Chess Challenger uses a Shannon-A S: raven of 
jterative search, to calculate all possible moves for both 
Sides up to a set depth. The Shannon-B Strategy, of non- 
1terative search for new calculations, searches certain 
moves, Without re-calculating already searched moves, to 
further depths of up to ten or more half-moves.[Ref. 8] 

At times, the subjects were unaware of possible 
threats which simulated the situation wherein a threatening 
piece could be beyond their sensors' ranges. Without 
knowledge of the possible threat, a subject's countermeasure 
was usually not the best or even second best alternative. 
If this happened, the Chess Challenger could not continue 
play from its generated repertoire of anticipated moves. 
Even when the subject picked one of these less likely 
responses, the Chess Challenger still indicated most of its 
moves Within five seconds. 

The Chess Challenger displayed the time taken 
for each move. This unofficial time was used to inform 
Subjects when they were within thirty seconds of incurring a 
penalty for not having completed their move. The o£f£1¢iaml 
time was kept by the VAX system and the chess experiment 
software programs. The Chess Challenger five second playing 
time, the two minute time limit for each move by a subject, 
and the fact that each game was for no more than thirteen 


moves kept the games to about fifteen minutes each. 
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Son 2O0ktware 

The software used for the experiments is 
available on the WAR Lab VAX system in the CHESS directory. 
The iconic symbol software used for the graphics experiment 
was written by Risney and Air Force Captain James Tschudy, 
A lis The graphics software uses statements and calls of the 
Precision “Visuals Incorporated DI-3000 graphics software 
system, as modified by Lawrence Livermore Laboratories. The 
graphics software displayed red iconic symbols for the 
challenger chess pieces and blue iconic symbols for the 
Friendly chess pieces. Monochrome-green was made by 
disconnection of the red and blue color leads to the RAMTEK 
Hemicors. The graphic software continuously displayed a 
menu which facilitated castling and random data saves. 

The applications software automatically 
controlled the presentation and recording of data. THEeOugn 
Simple questions and menus, the applications software guided 
the umpire and player through each trial. The software 
recorded the trial set up, the player's identification and 
experience level, the moves made, the official time-to-move, 
the score entered by the umpire, and the experiment end-game 
chessboard piece positions. Evaluation scores were recorded 
after moves eight, nine and ten although these data could be 


recorded at any point in the game. 
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c. Questionnaire 
At the conclusion of each subsect's four eriauee 
the subject completed a questionnaire. The questionnaire was 
used to remove experimenter speculation during the analysis 
of the collected data. Appendix D contains a sample 


questionnaire. 


C. CONDUCT OF THE EXPERIMENT 
1. Scheduling 
The experiment was conducted in the NPS WAR Lab from 
19 September to 29 October, 1984. Fifty-minute blocks were 
allocated to play the 208 games. Pilot trials showed that 
two games could easily be completed in a fifty-minute block. 
Therefore, three fifty-minute blocks were planned for each 
Subject to complete the trials and allow for contingencies. 
2. Game Preparation 
Every subject was expected to be familiarize himself 
With the game of chess if necessary by availing himself of a 
chess game which was provided by the author for practice 
purposes. The subjects were briefed during the academic 
quarter before the conduct of the experiment and were given 
a handout [Appendix B]. The handout explained the rationale 
EOE the experiment and stated the experimenter's 
expectations for preparation and Pparticieavion- The player 


instructions were abbreviated because the participants had 
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all used the necessary WAR Lab equipment at one time or 
another and explicit A aaneioune were not needed. 

Prior to a player entering the WAR Lab, the 
appropriate equipment were arranged and the first displays 
were initialized for the scheduled participant. When a 
Participant first arrived in the WAR Lab, he or she was 
questioned about personal preparation, and was told that no 
outside aids could be used. 

A briefing and demonstration was provided concerning 
the player keyboard entries, the terminal and monitor 
Gisplays, the use of the keyboard, and the mouse and tablet 
interface devices. The following instructions were given: 

1. They would play four chess games. 


2. Each game would have a different scenario and each 
scenario would be started mid-game. 


3. A different level of information would be presented 
during each game. 


4, An overview of the four information levels waS given 
prior to the start of the experiment and prior to each 
game. 


5. Each participant should think of the chess pieces as 
Military elements. A suggestion was tendered that 
each chess piece should be attributed with 
characteristics and cavabilities in consonance with a 
given piece's maneuverability. That is, to consider 
the concepts of line of sight, field of fire, and 
radar skip zones. 


6. Each game would not necessarily be played to its 
Hounal conelusion. 


7. The player had the first move. A reasonable time to 


Study the initial displays, without penalty, was 
allowed. 
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oo” ge more that two minutes were used for each 
subsequent move, a point penalty would be assessed. 
The penalty would not effect the play of the game. 


9. Any questions whose answer would not affect play 
would be answered. 


At the conctusion of each game, the subject was 
asked if he or she wanted to continue and play the next game 
immediately, or to return later to play the next game. 

3. Monitor Displays 

The umpire's monitor always displayed a normal 
chessboard view of the selected scenario. All the chess 
pieces were shown with the player's pieces in blue and the 
challenger pieces in red. 

The player's monitor displayed ovieces according to 
the scenario and information level criteria selected by the 
umpire. If the subject was to play the games in color, the 
chessboard surface consisted of black and white squares. 
The subject's chess pieces were shown in blue and the 
visible challenger chess pieces were shown in red. If the 
subject was to play the game in monochrome-green, the 
chessboard surface was monochrome-green and black. All the 
visible chess pieces in the monochrome experiment were the 
same "color". For the monochrome experiment, the visible 
challenger chess pieces were identified for the player prior 
to starting each game. Thereafter, it was up to the player 
to remember, or determine, which piece(s) was friendly. A 


player Cound not move a challenger piece, bug 
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Peel pee VOnNO rt PiLendeaOrmenocmwacenOt trivial. The player 
could capture his own chess piece. eeeuw=e Of the 
monochrome-green games, a player's own chess piece was 
Ftaken" by friendly fire. 

Examples of three of the four information levels are 
Sicown iWhiemeg@eaonte form in Figures, ILI-8 to ITII-10. 
Information level three examples are shown in Figures [II-3 
Emeough TLil—o- To reiterate, 1 represents the least amount 
of information, and 4 represents the greatest amount of 
mnieormatzon. The displays for the least amount Or 
information showed the subject's chess pieces and only those 
enemy pieces which could be attacked. For level 2, the 
basic displays were the same as for level 1 with safe 
squares identified. For level 3, all chess pieces were 
displayed. For level 4, safe squares and vulnerable enemy 
pieces were identified, and all the chess pieces were shown. 

Additional graphics displays are shown by scenario 
and selected information levels in Figures III-ll to III-13. 

4. Game Turn 

The first move of every game was made by the player. 
The player's monitor always displayed the currence 
disposition of all appropriate chess pieces. 

A game turn consisted of a move by the player 
followed by a move by the umpire. The subject would move 
the mouse on the tablet until a cross—-hair was on the piece 


he or she desired to move, Or on a menu item, as 
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appropriate. The subject pressed a button on the mouse to 
indicate to the computer which piece to move. The player 
moved the cross~-hair to a square to which he or she desired 
to move the marked piece, and again signaled the computer by 
pressing a button on the mouse. If the indicated move was 
legal, the computer's internal clock stopped. The time 
taken for the move was”) saved. The indicated piece 
disappeared from its current position and reappeared in the 
selected square. After a player completed a move, control 
was immediately transferred to the umpire's devices and 
displays. At all times, the umpire's monitor display showed 
the current disposition of all the chess pieces. 

The umpire used the same type of computer devices 
and the Chess Challenger. To make a move, the current 
positions of the chess pieces were noted and the Chess 
Challenger chess pieces were positioned accordingly. Within 
approximately five seconds, the Chess Challenger indicated 
Which of the challenger pieces to move and where to move it. 
The Challenger's move was indicated to the main computer 
With mouse and tablet devices the same way the player 
indicated his move. If the challenger's intended move 
completed game move eight, nine, or ten, or there was a 
desire to save the current monitor display and enter a 
score, the Chess Challenger was again used. A hexadecimal 
score was obtained from the Chess Challenger and entered 


into the main computer system with the terminal keyboard. 
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Any move registered by the subject or umpire, ite 
was alegal move, was final. There was no provision for 
taking back or changing a move once it was indicated to the 
System. This simulated the reality of a )commprment ie 
forces. 

5. Bsetojece 

The player's terminal was initialized by the umpire. 

For each game, the player used the keyboard to select a 


RAMTEK monitor on which the appropriate displays would 


appear. The player entered a name with which to oe 
Ldent ie ted This name was used to collocate the data 
collected from an individual participant's four games. The 


player entered his or her skill level using menu [Figure 
[Ili-/] detiniriions. 

Once the game began, the player observed the RAMTEK 
monitor display and interfaced using the mouse and tablet. 

6. Experimenter 

The experimenter performed several taskS prior to 
and during the administration of each game [Appendix C]. 
All appropriate WAR Lab devices were checked to see if they 
were properly connected and interconnected electrically. The 
Physical location of pertinent equipment was checked to 
ensure it was inaccord with the experiment equipment 
configuration design. If a game was to be in monochrome- 
green, the red and blue color leads to the player's RAMTEK 


monitor were disconnected. If a session entailed more than 


oho) 


one game, a single check of the equipment and configuration 
usually sufficed unless a subsequent game required the 
connection, or disconnection, of the red and blue leads. 
The experimenter logged the player onto the computer system 
and made the player terminal ready for player provided 
imo & » The experimenter then returned to the umpire 
position to log on a terminal. 

The umpire displays consisted of menus and simple 
answer questions to call the appropriate displays for each 
game. The intended graphics displays would appear on the 
umpire and player RAMTEK monitors simultaneously. 

Before commencing each game, the player was briefed. 
Questions were fielded from the player, and time was given 
for the player to study the monitor display while the umpire 
set up the Chess Challenger game board. When the player 
indicated he or she was ready, the game officially began. 

After each subject finished playing four games, the 
experimenter gave the subject a questionnaire [Appendix D] 
to be completed and returned to the experimenter as soon as 


possible, 


D. SUMMARY 
This chapter provided a concise description of the 
methodology, the design and conduct, of the graphic 


experiment. The Graphic experiment was designed Lo 


replicate the O'Bryant and Risney alphanumeric experiment so ~ 
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the data from both experiments could be compared and 


analyzed more readily. 
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IV. ANALYSIS 


A. OVERVIEW 

Raw data were collected and collated from the 
alphanumeric and graphic experiments. The collected raw 
data is stored in the WAR Lab computer system and on a 
backup tape available in the WAR Lab. 

A score (MOE) was computed for each game by a multi-step 
process: 


1. The opening game material and positional values were 
computed for each of the four scenarios. 


2. The game score was normalized by subtracting the 
appropriate opening game value. 


3. Penalty points, if any, were computed. Times greater 
than 120 seconds for the second through tenth move 
were summed and divided by 60. This value was rounded 
up to a whole number. The whole number was multiplied 
by the value of one Pawn (-256). The result was the 
number of penalty points to assess. 


4. The game MOE Was the normalized score plus any 
penalty. 


The value chosen for checkmate was =3 27 oe The 
Pmaseruction booklet for the Super Sensory "9" Chess 
Challenger suggests this game score for checkmate. 

The game scores were entered manually into three data 
files for analysis on an International Business Machines 
(IBM) 3033 (the statistical program used for analysis was on 
the NPS common user IBM system; the data could not be 


electrically transferred between the DEC and the IBM systems 


oe, 


for security reasons). The data files contain five columns. 
Column one contains the subject jdentit teaeetee numbers. The 
names OF the subjects were used only to schedule 
participants and provide a check to ensure each subject 
played four games. Column two shows the subject's self 
evaluation of skill level. Column three is the numeric 
intelligence level or amount of incouwaeonn Column four ge 
the number of the scenario. Column five contains the 
adjusted game score in decimal form. Each file shows’ the 
data by trial number. Table III-1l is the data file for the 
color phase of the graphic experiment, Table III-2 is the 
data file for the monochrome phase of the graphic 
experiment, and Table III-3 is the data fite (for 3uage 
alphanumeric experiment as used in my analysis. 

Preliminary analyses of the data, doing number lines, 
scatter diagrams, histograms, frequency polygons, and 
deterministic statistics (finding mean, mode, and median) 
identified outliers. The outliers were scores reflecting 
checkmate or imminent checkmate. The outlier scores were 
randomly dispersed throughout the data files. The outlier 
scores, five from each data file, were dropped. To leave 
these scores in the data base would have resulted in 
Variances so large as to make impossible the detection of 
any significant differences in the factors of interest. 

The data files were arranged and combined for computer 


assisted analysis. For the computer analysis, the data were 
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ordered and manipulated to fit the analysis program and 
memory space allotted to users. The scores were divided by 
-100 to make the numbers more manageable. 

Several statistical packages are available at NPS for 
analyzing data. Interactive Statistical Computing 
(MINITAB), Statistical Programs for the Social Sciences 
(SPSS), Statistical Analysis System (SAS), and others were 
looked at and rejected. For the statistical analysis of the 
collected and collated data, the author used an analysis of 
Variance (ANOVA) computer program developed by Professor 
mEchnards. The program is written using A Programming 
Language (APL). 

Richards’ program uses the entire model and then may 
repeat the ANOVA on a reduced model. If omitted data or 
interacting variables prevent the use of the full model, the 
program reverts to a reduced model. The algorithm 
systematically omits the factors under investigation which 
have the smallest importance in explaining the data. The 
main table produced by the ANOVA program lists the R-Square, 
the Source of Variation, Degrees of Freedom (DF), Sum of 
Squares (SS), Mean Square (MS), calculated F-test statistic, 
amc olgnificance., The ANOVA table factors are individually 


evaluated and tabulated as Main Effect data. 
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B. ANALYSIS DISCUSSION 

The ANOVA program was run separately for the color, 
monochrome, and alphanumeric data. It was also run uSing 
the data collated from both the alphanumeric and the graphic 
experiments. Therefore, the same format is used for 
reporting the analysis of the data for ease of reading, 
understanding, and comparison. 


The null hypothesis (H,) for each case is that the 


0 
factor had no effect on the test scores. For each f£actormam 
F-statistic is presented and a significance level is 
determined. The Significance level indicates the 
probability that a value of the F-statistic as large as that 
computed could have resulted due to randomness if the null 
hypothesis were true. For the discussion purposes, we 
selected a significance level of .05, a confidence interval 
of .95, to base our decision about rejection o£ the 
hypothesis. 

Comments on the Main Effect data for the significant 
ANOVA table factors follow the appropriate factor 
discussion, All the factors and main effect data ware 
discussed in the analysis of the grouped data for comparison 
purposes. 

Questionnaire responses are discussed separately. ie 
general, chess iS an anticipatory game which normally allows 
predictlongwith a degree Of sceneamney: With degradation of 


information (less than the normal chessboard view), 
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prediction was nearly impossible. But, the levels of 
imrEormation were semesnded to simulate battlefield 
GOnailtions, and they do. This is most evident when the 
information levels are compared with submarine warfare or 


military countermeasures to insurgence. 


eee ULSCUSSION 
1. Color Experiment 
Table IV-l 1s the ANOVA table and Main Effect data 
for the color phase of the graphics experiment. ° 
a. Intelligence 
At a 95% confidence level, intelligence (the 
amount of information) has an effect on the MOE. 
(ia) Paeeiudence Maanmenhetect , Sub jects» did 
best with the normal view of the chessboard. They did worst 
With the least amount of information. The difference 
between worst and best is significant. There is very little 
difference in scores between information levels 2, 3, and 4. 
Deas cenar 10 
At a 95% confidence level, the scenario has an 
Seeect on the MOE. 
(1) Scenario Main Effect. Subjects did best 
With scenario 2. They did worst with scenario 3. The 
difference between scenario 2 and 3 is significant. There 
is very little difference in scores between scenarios l, 2, 


and 4, 
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TAB ME vo 
COLOR EXPERIMENT ANOVA TABLE 
COLOR CHESS EXPERIMENT 


R-SQUARE = som 


SOURCE OF VARIATION be SS MS 2 SIG 
TOTAL 98. 22169766 S22cee 
ERROR o/, [43752005 lose 
MODEL ll. 7794.846 708.622 4520 05eee 
FACTOR 1. INTELLIGENCE 3. 1391.723 463.908 2.603m0Riaas 
FACTOR 2. SCENARIO 3. 3054.62 1018.207 6.162503 
BPACTOR 3.2) TERIAL 3% 357.888 119.2960. 7/22 oe 
FACTOR 4. EXPERIENCE 2. 2445.732 1222.866 /.4010 50g Gae 


MAIN EFFECT 1]: 


LEVEL COUNT MEAN 
al i SEA SUS, 
2 Zo a8) KALIL SYS) 
5) 26 2a 96 
4 26 WAIN LING 
MAIN EFFECT 2; 
LEVEL COUNT MEAN 
1 Ze 23.0848 
2 22 LO Zo 2 
3 24 34.8067 
~ Zo Zee Lo 
MAIN EFFECT 4: 
LEVEL COUNT MEAN 
J Dies 36.2407 
Z 80 22 lS) 
3 4 INS) lop 5 


64 


AF adlicoe-lk 

At a 95% confidence level, the trial has no 
effect on the MOE. This was as desired as it suggests that 
learning was not a significant factor. 

ad. Experience 

At a 95% confidence level, the experience of a 
player has an effect on the MOE. 

(1) Experience Main Effect. Level 2 subjects 
did the best. Level 1 subjects did the worst. The 
difference between level 1 and 2 is Significant. There is 
little difference in scores for level 2 and 3 subjects. 
The reason for level 2 subjects doing better than level 3 is 
probably due having only one level 3 subject. 

2. Monochrome Experiment 
Table IV-2 1s the ANOVA table and Main Effect data 
for the monochrome phase of the graphics experiment. 
a. Intelligence 

At a 95% confidence level, intelligence has an 
effect on the MOE. 

(1) Intelligence Main Effect. Subjects did 
best with the most amount of information presentation. They 
did worst with the least amount of information. The 
difference between worst and best is significant. There is 
a Significant difference in scores attained with information 


levels 2 and 3, and those with information levels 1 and 4. 
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TABLE [V2 


MONOCHROME EXPERIMENT ANOVA TABLE 


MONOCHROME CHESS EXPERIMENT 





R-SQUARE = roo E 
SOURCE OF VARIATION DF SS 
LOLAL 98. 18964.259 
ERROR 87. L2ob457 33 
MODEL Ll. Woe 
PACTOR*.1.. 2NTEELUGENGE 3. “Zee ont 
FACTOR 2. SCENARIO 5) See 
PACTOR 3. “TRAE 34 $8 620r)2 
FACTOR 4. EXPERIENCE 2 2355. 028 
MAIN SES ECT i= 
LEVEL COUNT MEAN 
af 22 Si FS AO 
2 22 23.6840 
3 Z> 20.2680 
of 24 Leo 9 a2 
MATIN Ge erie ie 
LEVEL COUNT MEAN 
a 24 226 > 
2 26 PAP pasa ILS) 
3 24 26.3254 
~ ihe 200096 
MAIN EFFECT 4: 
LEVEL COUNT MEAN 
1 eZ SSmvnrs 3 
2 fe Z2a91 20 
3 LLY La 2 
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b. Scenario 
At a 95% confidence level, the scenario has no 
effect on the MOE. This falsely suggests that monochrome 
displays are better because the scenario significantly 
affected the scores in the color phase and the alphanumeric 
experiment. Although the monochrome phase subjects did best 
With scenario 4 and worst with scenario 3, the difference is 
not significant. The scenario 3 scores were better than the 
non-monochrome scenario 3 scores. This can probably be 
explained by one fact that the monochrome phase required 
more concentration. In the non-monochrome games, a vrobable 
lack of concentration caused oversight, resulted in the loss 
of major friendly pieces, and the subjects could not recover 
from the losses as reflected in the bad scores. 
Ge. Warad 
At a 95% confidence level, the trial has no 
effect on the MOE. 
d. Experience 
At a 95% confidence level, the experience of a 
player has an effect on the MOE. 
(ia) Experience Main Effect. Level 3 subjects 
did the best. Level 1 subjects did the worst. The 
difference between levels 1, 2, and 3 is significant. 
3. Alphanumeric Experiment 
Table IV-3 is the ANOVA table and Main Effect data 


for the alphanumeric experiment. 
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TABLE 2V-—s 


ALPHANUMERIC EXPERIMENT ANOVA TABLE 


ALPHANUMERIC CHESS EXPERIMENT 


R-SQUARE = .2601 


SOURCE OF VARIATION 


TOTAL 
ERROR 

MODEL 
FACTOR#... 
FACTOR] 2. 
PACTORVS. 
FACTOR 4. 


INTELLIGENCE 
SCENARIO 
TRIAL 
EXPERIENCE 


MAIN RPE ECT 2; 


LEVEL 


Wm UW NO FF 


COUNT 
30 
onl 
28 
Z9 





DF SS MS 
117. 259500349 “22hmeey sig 
TOG. 19201 egy bore, 
lle 6748: /42™ot Soe 
a) 741.131 247.044 
3..> 4958.23 16527748 
on 525 5025 fan Uo 
a 371.968 1eseeG2 
MEAN 

19.6843 

25102 0D 

35.4200 

18.7634 
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a. Intelligence 

At a 95% confidence level, intelligence has no 

effect on the MOE. 
Dee ocenar Lo 

At a 95% confidence level, the scenario has an 
effect on the MOE. 

(1) Scenario Main Effect. Subjects did best 
with scenario 4. They did worst with scenario 3. The 
difference between scenario 3 and 4 is significant. There 
is very little difference in scores petween scenarios 1 and 
4. Scenario 2 resulted in a mid-range score. 

eg 9 Wile abel 

At a 95% confidence level, the trial has no 
effect on the MOE. 

d. Experience 

At a 95% confidence level, the experience of a 
player has no effect on the MOE. 

4, Grouped Data 
Table IV-4 is the ANOVA table and Main Effect data 
for the grouped data of the graphics and alphanumeric 
experiments. 
a. Intelligence 

At a 95% confidence level, intelligence has an 
Serrect on the MOE. 

(al) Intelligence Main Effect. Subjects did 


best with the most amount of information. They did worst 
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SOURCE OF VARIATION 
TOTAL 
ERROR 
MODEL 
FACTOR 1. INTELLIGENCE 
FACTOR 2. SCENARIO 
FACTOR 37 TERIAL 
FACTOR 4. EXPERIENCE 
FACTOR 5. PRESENTATION 


MAINGEREECT i: 
LEVEL 


m GNF 


MAIN EEEECG?. 2: 
LEVEL 


m WN FF 


MAN BEE EGie 
LEVEL 


WN FF 


MATNPEREE CI. 5; 
LEVEL 


WN FF 


TABLE IV-4 


GROUPED DATA ANOVA TABLE 


COUNT 
719 
82 
76 
Wie, 


COUNT 


302. 


R-SQUARE = 


DF 


52 


SS 


GROUPED DATA 
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13. 160326. 7) 7 ize 
3. 4473. 3390eleol 
» ©/935425522648 
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21.2486 


MEAN 
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with the least amount of information. The difference 
between worst and best is’ significant. The differences 
between levels 2, 3, and 4 are not significant. 
b. Scenario 
At a 95% confidence level, the scenario has an 


effect on the MOE. 


Cb) Scenario Main Effect. Subjects did best 
With scenario 4. They did worst with scenario 3. The 


difference between scenario 3 and 4 is significant. There 
1s very little difference in scores between scenarios 1, 2, 
ama 4. For the subjects to do worst with scenario 3 was 
expected. The scenario was such that the subject's Queen or 
other significant chess pieces were immediately in jeopardy. 
In a sense, the beginning of the game simulated an initial 
graphic display (briefing) of an imminent multi-pronged 
attack. Within a couple of moves, the subject's Queen or a 
few other major pieces were gone. The scores show that 
effective recovery was not possible. 
Sec La 
At a 95% confidence level, the trial .has no 
effect on the MOE. 
qd. Experience 
At a 95% confidence level, the experience of a 
player has an effect on the MOE, 
(1) Experience Main Effect. Level 3 subjects 


did the best. Level 1 subjects did the worst. the 


vee 


difference between level 1 and 3 is significant. Level 2 
subjects' scores were about midway between the scores for 
the other levels. Level 3 subjects were expected to do 
better. However, the difference in scores for level 2 and 3 
participants, although not statistically significant, were 
larger than expected by the author. 
e. Presentation 
At a 95% confidence level, the method of 


representing information has no effect on the MOE. 


D. QUESTIONNAIRE RESPONSES 
1. Overview 
A questionnaire was developed to assist in the 
evaluation of results of the graphics chess experiment. 
Appendix F contains a sample questionnaire. All the 
subjects rated themselves on the aggressiveness of their 


play. They also rated themselves on the use of additional 


information. Additional information was provided for 
information levels 2 and 4. In level 2, safe squares were 
marked, In level 4, safe squares and vulnerable enemy 


pieces were identified. Discussions with the players at the 
conclusion of the four games and written comments on the 
questionnaire provided insight to the play of the games. 
2. ~ Color Experiment 
Table IV-5 shows results of the questionnaire 


regarding usage of available information. Over fife 
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TASES LV—5 


COLOR QUESTIONNAIRE RESULTS: INFORMATION 


REKKKKKKKKE KES Level 2 Use of Information 


Use of Information Percent 
Not at all 4 
For few moves 4 
For half the moves eZ 
FOr most moves 58 
For all moves Za 


KEEKEKKKKKKKKKE Level 4 Use of Information 


NOTE: 


Use of Information Percent 
Naeoateall: a 

For few moves 8 
For half the moves ae 
For most moves 54 
For all moves eZ 


Rounded percentages are used in the 
totals may not equal 100%. 


Ws 


KHEKRKKKKKKKKKEKRE 


Number 
al 
1 
3 
15 
iy 


kKARKRKRKKKEKKKKRKREK 


Number 
1 
2 
6 
14 
3 


tables and some 


percent of the subjects used the additional information for 
most of their moves. A few subjects used the information 
very little, or not at ale Experienced players filtered 
what they considered extraneous information. They also 
filled information gaps and played against probable 
challenger pieces and strategy. There was not a Significant 
difference between the use of additional information between 
levels 2 and 4. 

Table IV-6 shows the aggressiveness of the subjects 
for each level of information presented. For three of the 
information levels, subjects tended to become somewhat or 
more aggressive toward the end of a game. With information 
level 4, the subjects tended to become somewhat offensive in 
their play. 

3. Monochrome Experiment 

Table IV-7 shows results of the questionnaire 
regarding usage of available information. All the subjects 
used the additional information when it was provided. Over 
fifty percent used the additional information for most of 
their moves. Again, experienced players filtered what they 
considered extraneous information. They also filled 
information gaps and played against probable challenger 
pieces and strategy. There was not a significant difference 
between the use of additional information between levels 2 


and 4, 
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TABLE IV-6 


COLOR QUESTIONNAIRE RESULTS: AGGRESSIVENESS 


RAKKKKEKKEKRKKESR 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


RARER KKKKKERE 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


RRKEKKKEKRKEEKRE 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


KREKKKKKEKKEKEKKE 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


NOTE: 


Level 1 Aggressiveness 


Beginning of game 
Percent 


Ik 
Syl 
23 
dS) 
ie 


Level 2 Aggressiveness 


Number. 


W & OO Ul 


Beginning of game 
Percent 


dk 
By 
oil 
Ike 
8 


Level 3 Aggressiveness 


Number 


NO & CO ~) O1 


Beginning of game 
Percent 


ay 
eZ 
42 

4 


Level 4 Aggressiveness 


Number 


ik 


rr wr~) 


Beginning of game 
Percent 


Number 


W ~~) © ~J Fr 


totals may not equal 1003. 


ie 


RRRKKEKKKEKEKEER 


Toward end of game 


Percent Number 
19 5 
Sak 8 
Sik 8 
5 4 
4 1 


RRRKEKRKKKKEKKEEKRKSE 


Toward end of game 


Percent Number 
19 5 
Sul 8 
its 4 
oe 7 
8 2 


RKERKERKRRKRKEKEKRESE 


Toward end of game 


Percent Number 
42 leak 
19 3 
Da) 7 
4 Jl 


RAXRKEKKKEKEREEKSE 


Toward end of game 


Percent Number 
12 5 
ae ii 
19 5 
Sell 8 
eZ 3 


Rounded percentages are used in the tables and some 


RARRKKRKKRRRKRKRER 


RKKKKKKKKRKEKRER 


NOTE: 


MONOCHROME QUESTIONNAIRE RESULTS: 


Use 
Not 
Kor 
For 
Or 
FOr 


Use 


OF Information 
at all 

few moves 

half the moves 
most moves 

all moves 


Of INnEOEMatioen 


TABLE LV aay 


Not at all 


FOr 
EOr 
Bor 
For 


Rounded percentages are used in the 


few moves 

half the moves 
most moves 

all moves 


Level 2 Use of Information 


Percent 


0 
8 
AE 
50 
Sul 


Level 4 Use of Information 


Percent 


0 
7% il 
FS 
50 

8 


totals may not equal 100%. 
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INFORMATION 


RREKRKKRKRKRKRKKKEKREE 


Number 
0 
2 
3 
is 
8 


RRKRKKRKREKREKREERE 


Number 
0 
7 
4 
3 
Z 


tables and some 


Table IV-8 shows the aggressiveness of the subjects 
for each level of information presented. For three of the 
information levels, subjects tended to become somewhat or 
more aggressive toward the end of a game. With information 
level 3, the subjects tended to become somewhat to very 


defensive in their play. 


E. SUMMARY 

This chapter provided an in depth analysis of the 
collected data andthe questionnaire. The effects and 
Significance of the model factors were represented by ANOVA 
tables and Main Effect data. The factors and main effects 
of significant factors were discussed. 

The following chapter discusses the conclusions and 


recommendations. 
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TABLE IV=6 


MONOCHROME QUESTIONNAIRE RESULTS: AGGRESSIVENESS 


KKKEKKKKEKKKEKER 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


KKEKKRKKRKKREKER 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


KERR KKKKEKKEEEKR 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


REEKKKKKKKKRKEK 


Rating 
Very defensive 
Somewhat defensive 
Neutral 
Somewhat offensive 
Very offensive 


NOPE: 


Level 1 Aggressiveness 


Beginning of game 
Percent 


oil 
ii] 
eZ 

4 


Level 2 Aggressiveness 


Number 


kr W ~] © 


Beginning of game 
Percent 


Level 3 Aggressiveness 


Number 


he OS WO OD 


Beginning of game 
Percent 


Level 4 Aggressiveness 


Number 


ke m WO WO W 


Beginning of game 
Percent 


Al 
cpl 
Bo) 
Ike 
8 


Number 


bo Bm WH OC W 


totals may not equal 100%. 
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KKK KEKKKKEKKKEKESK 


Toward end of game 


Percent Number 
42 aij. 
4 il 
19 S 
4 JI 


REKRKRRKRRKRRKEKRKEKE 


Toward end of game 


Percent Number 
19 5 
23 6 
8 2 
42 Wk 
8 Z 


REKRKRKEKRKEKRKERRKRER 


Toward end of game 
Percent Number 
8 2 
fos) g 
iS = 
38 10 
+ 1 


KEREKKKKKRKRKEKRKRKEKEK 


Toward end of game 


Percent Number 
8 
5 4 
23 6 
46 1Z 
8 D 


Rounded percentages are used in the tables and some 


ve CONCLUSIONS AND RECOMMENDATIONS 


fee OBJECTIVE REVIEW 

This study waS an investigation of the effects of 
three different ways of representing four different amounts 
of information. The information was represented by 
alphanumeric, color graphic, or monochrome-green graphic 
displays. The study used a variation of the game of chess 
as a War game requiring sequential decision making. The 
play of the games and collection of data was computer 
controlled. Each game was terminated at a predetermined 
move and a game score was derived. The score reflected the 
gGuality of the decisions made in a conflict environment. 
The game score was used as the measure of effectiveness 


(MOE). 


Eee CONCLUSIONS 
ieee ri cake Conelusions 

The reporting of decisions made was much quicker in 
the graphics experiment than in the alphanumeric experiment. 
mem reason for this could be attributed to one or a 
Somoimnation of two factors. 

Although the grouped data indicated no measurable 
differences in scores due to the method of presentation, it 


appears that the subjects could comprehend a level of 


19 


information in graphic form much faster than when the same 
information was presented in alphanumeric form. The time 
taken to make decisions known was much less in the graphics 
experiments than in the alphanumeric experiment. The 
average time difference could be explained by the manner in 
which the decision was communicated. The subjects in the 
alphanumeric experiment were required to enter their 
decisions in standard chess format using a keyboard. 
Familiarity with the standard chess format and typing skill 
could have accounted for the difference in the perceived 
time to repert. The subjects in the graphics experiments 
used a mouse and tablet to report decisions made. A mouse 
and table greatly facilitated quick reporting of decisions 
INade. A second button push on the mouse completed the two 
step sequence necessary to make most moves. The «;enpurces 
program translated the button pushing to standard chess 
nomenclature. This is comparable to sending formatted 
messages where a button push or two puts routing 
instructions and a heading on a message. 

The conclusion is that coding facilitates data 
transfer. For the most efficient and effective 
communication to take place, the following must happen. The 
sender must be able to indicate which data elements are to 
be in the intended message in a way he or she _ has 
competence. The data elements are collected, encoded, and 


transmitted. Some mechanism receives the transmission and 
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decodes the data into a form comprehensible to the 
recipient. The decision made by the recipient is the 
feedback showing if communication took place. Communication 
takes place when intended messages are acted upon in accord 
With the senders intentions. 

2. No Optimal Amount of Information was Used 

Four different levels of information were used in 
the experiments. If one of these would have been optimal, 
its presentation would have resulted in the best MOE. 

The concept of information overload can be described 
by two regions: (1) As input increases from zero, the 
amount of output goes from zero and increases almost 
linearly to a threshold region. (2) If there is more 
input, the amount of output decreases. 

When an overload occurs, the sensory capacities and 
capabilities have been overtaxed. The consequence of 
additional information is manifested in several forms. 
Organisms succumb to, compensate for, or cope with an excess 
of information several ways. A person can ignore it, filter 
it, selectively pick and choose available input, or group 
input in synopsized, comprehensible chunks. The object of 
doing something positive is to get back on the rising 
portion of the information overload curve. In all cases 
performance decreases and the result is a decrease in the 


quality of decisions made. 


on 


With decision making, less than the essential amount 
or an overload of information results in less than optimal 
decisions. With sequential decision making, the probability 
of repeatedly correctly guessing and filling in several 
information gaps, or correctly selecting from a mulercudemems 
data, is infinitesimal. Although humans are creative, the 
end result is a low quality decision made. 

3. Factors Affecting Use of Information 

Experience of the user, the scenario or situation, 
and the method of representing information effect the 
utility Ofgan amount, of intorpnacien- 

Experienced decision makers compensate if the amount 
of received information iS not optimal. Experienced 
decision makers fill in gaps when there is a deprivation of 
information needed to make a quality decision. They filter, 
Or selectively use available information when the 
information provided iS more than they need to make a 
quality decision. 

The beginning scenario or Situation may cause the 
decision maker to misapply resources. Regardless of the 
amount of information available, the initial situation may 
have too many variables requiring the decision makers 
attention. If the decision maker ignores or overlooks a 
Variable he or she has a contingency. The value of 
experience in decision.making is in having coped with past 


contingencies. We never have perfect information. The 
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question is not whether we will pass from planned action to 
experienced reaction, but when will such a transition be 
required, and has our training and experience prepared us 
for the eventuality. 

The method of representing information affected the 
information overload threshold. An amount of information in 
alphanumeric form which causes an information overload may 
not cause an overload if it is represented in monochrome 
graphic form. The highest amount of information displayed in 
the experiments did not overload the subjects who received 
the information in monochrome-green graphic form. The 
conclusion is that the means of representing information is 
Significant and leads to ahigher or lower information 


overload threshold depending on the method chosen. 


C. RECOMMENDATIONS FOR FUTURE STUDY 
1. Determine Monochrome Threshold Region 
There was no information overload in the monochrome 
phase of the graphics experiment. A follow-on study to 
bound the threshold region for information overload using a 
Variation of chess could be conducted. 
2. Determine Information Overload Region 
This study did not find an optimal amount of 
micormation. A study to determine the threshold regions 


could be conducted. 


8 3 


3. Increase Tasks 
Additional experimentation with more difficums 
information processing tasks could be conducted. Maybe this 
experiment did not challenge the abilities of the players 
enough. 
4, Vary Decision Time 
Replicate experiments and allow one and four minutes 
for a subject to make a move. The object would be to 
determine if a decrease or increase in time would affect the 


MOE. 
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APPENDIX A 


TABLES 


io ed — 


COLOR EXPERIMENT DATA SHEET 


TRIAL l 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
i Z 3 1 -2274 
2 Z 2 it —327 0% 
3 2 1 1 -~4115 
4 zZ 4 1 -4075 
5 Z 3 il -2436 
6 iL 2 1 -6134 
di 1 1 2 af 8) J) 
8 2 4 Z =e 
2 2 3 Z =o) 
10 Zz Zz Z eile) Ss 
a 2 iL 2 = Zion) 
eZ & 4 2 = OneZ 
iS 2 3 3 — Fo 
14 Z 2 3 =e 
-) 2 L S -4558 
16 Z 4 3 =1555 
iE] Z 3 3 -6i9 
18 1 2 3 =3E103 
Oe 1 1 4 -4295 
20 Zz 4 4 = len) 
ZA. Z 3 4 = 
Ze 2 2 4 =o 
8. 2 1 4 —32/56* 
24 Z 4 4 a) 
25 Z 3 1 -414 
26 2 3 4 = 3595 
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TABLE III-1 [CONTINUED] 


TRIAL 2 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 

i) Z 2 Z - 20m 
2 2 2 2 -1404 
3 2 3 3 -2884 
4 Z 3 2 -640 
2 Z 2 4 —-2 1a 
6 1 3 4 -1548 
i i 3 Ik — 1602 
8 2 3 al -l_ j= 
2 Z il 3 -4467 
10 2 1 2 -2886 
ea 2 2 4 - oer 
MZ 3 2 4 ~l_ iz 
Ae Z 1 1 -9 Om 
14 2 al 1 -l19o22 
Aes: Z Z Z -3141 
16 2 2 2 — ie 
le, Z 4 4 -630 
rs: i + + -30G2 
Ike, i = 1 - 1568) 
20 Z it 1 -2660 
7a 3 2 + 2 -66u 
Ze 2 + i ~1 a2 
23 Z + 3 - 642 
24 Z al E -32/555 
25 Z 2 a -2074 
26 2 2 2 = 2 Oil 
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SUBJECT 


Oo Om OD UI W DN Fe 


ee 
WNHO 


bY 
U1 


Keb 
oO ~1 0) 


NOM DNDN NF 
U1 & DF’ © 


INO 
©} 


SKILL 
LEVEL 


DMN ND NHONEFFINN DNDN NH WDD NN EF’ FD D DN ND ND 


Tr Ais 


INTELLIGENCE 


LEVEL 


MFPMrRrNMNFFWWWNE SP PB WW WYN E- PP SDN EF 
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TABLE III-1 [CONTINUED] 


SCENARIO 


FMWNFWEFWNHNE BPE BPN WE BE RW WY PD BP W 


SCORE 


=e O16 
-2740 
hence 74 
=e 9 
= 210317 
ee) ae! | 
-4413 
8 NG 
= fil 
= 2a 
-4409 
-4540 
oo” 
=e 
-431 
= 3OL 
-1148 
=S 145 
-4381 
-2784 
ales 
=g or / 
= 1 S7eZ 
A108) 4) (9) 
S32 
= O6 


TABLE III-1 [CONTINUED] 


TRIAL 4 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
1 Z 4 4 -l 538 
2 2 4 5) -2509 
3 2 + = -1664 
4 Z il a“ -Z ioe 
> Z il 3 -3270e— 
6 a JL Z -~32758@ 
} i 2 4 -le72 
8 Z 2 5 29a 
2 2 + + - 352 
1B Z 4 1 -15c5 
Jal Z + 3 ~ 2263 
12 3 i IE ~3/ 32 
rs 2 2 4 => 
14 Z é Z ~2 ie 
i> 2 5 + - 9G 
16 2 3 I — Siew 
IL 2 it Z -2546 
Thee: il ds i ~4226 
ig 1 2 é -4834 
20 2 2 2 -1 99 
Zk 2 Z 5 -3476 
Ze 2 3 8 -Z3a2 
ZS Z 3 2 -26035 
24 2 3 il - ae 
Z2 2 I + -1654 
26 2 4 3 —> 
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fApoe 6fr=2 


MONOCHROME EXPERIMENT DATA SHEET 


TRIAL 1 
SUBJECT SUS IESE INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
1 Z 3 il = 2a 
2 U Z 1 = 3255 ° 
5 2 a i = GS 
4 ZZ a tl a2 2) 9) 
5 2 5 1 ek SS) S, 
6 1 Z 1 -4212 
7 2 il zZ =2555 
8 Z 4 2 = S010 
9 3 3 Z = Or 
0 2 Z 2 = 20166 
line 2 aX 2 = 312 3D 
EZ 3 4 2 = Tae 
ES Z 3 é sae) 
14 a Z 5 =2 UZ 
ES 1 Ik 3 = 67000 
16 2 4 3 = To) 
17 2 5 3 -436 
18 2 Z 5 =56 72 
ae) 2 if 4 =2260 
20 Z 4 4 -1460 
21 5) 5 4 =olo / 
22 Z Z 4 22 
ZS 2 1 4 =41 6 
24 2 4 4 =17/ 6 
Zo Z 3 tr =—S. 0a 
26 2 3 4 =2919') 
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TABLE III-2 [CONTINUED] 


“STR ee ez 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 

il Z Z 2 -2490 
2 1 3 2 -3346 
3 y 3 3 — 2020 
4 Z 3 3 -964 
o) 2 2 4 -1483 
6 al 3 + —36e 
7 Z 3 ab -1463 
8 Z 3 1 -~l3ae 
2 5 1 3 -l ite 
10 Z il 3 -4809 
it Z Z + -4223 
eZ 5 Z + -864 
is 2 is at -38¢ee 
14 1 1 iL -2414 
i 1 Z Zz -3 i 
16 Z 2 Z +287 
17 Z 4 4 -564 
18 Z = 4 -2 i 
TS 2 x iL ~ 2910 
20 2 IL a -33Ge 
Za 3 + Z -~265 
ZZ 2 + Z -4184 
23 Z 2 5 -iZe 
24 Z 1 3 -327588 
Zo Zz Z 2 ~3 38 
Ze 2 2 2 =a 
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TABLE III-2 [CONTINUED] 


TRIAL 3 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
1 2 1 3 =O 
ZC il 1 4 —AGy > 
3 2 Z 2 en 2) ON, 
4 a 2 4 = ieee 
5 2 4 2 =o 
6 i 4 3 = es) 
u Z 4 3 -644 
8 Z il 4 = 240 
2 5 2 1 =e 
10 Z 5 4 eZ 
inal Z 3 1 = 3515 
2 3 & 3 -3594 
3 Z 4 Z SOs 
14 1 4 4 =Z2002 
ils a 4 iL = 327535" 
16 yu 1 4 — 2am 
ing] 2 2 ar lis) 3) F 
18 Z 3 c = Sie 
ee Z S 2 = 3055 
20 2 3 5 =3 02 
21 3 1 1 = 67 
22 2 1 3 = 50 08 
as iz Z 1 =2 ae 
24 2 Z 2 =29 65 
Zee 2 1 3 = EG 
26 2 il 1 -3464 
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TABLE III~2 [CONTINUED] 


TRIAL 4 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
iE 2 4 4 ~ Eze 
Za i os 3 -~32Z/2ee 
5 Z 4 4 ~14c0 
4 Zz 1 2 -5674 
5) 2 il 3 -29e2 
6 1 il 2 - 3Sie2 
7 Z 2 + ~2608 
3 Z 2 3 -4061 
9 3 d + — 4a 
10 2 4 i ~l54a 
eat 2 4 3 — 1 Sia 
IY 5} i 1 -2434 
IBS: Z Z + - ise.) 
14 i 3 Z -~1645 
iS ul 5 4 -32 7/2 
16 2 5 1 -1466 
le Za 1 2 ~léice 
Ales: Z l IL -4168 
lke 2 Z 5 -4577 
20 Zs 2 Z —2295 
Za é) B 3 ~l3am 
Ze 2 iS J) —6e5 
25 Z 3 2 -2246 
24 2 5) Al —2622 
Ze 2 4 4 ~ 4 
26 2 4. 5 -2004 
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suogeCTr 


19 CO ~I OV O1 B&B WN FPF 


ALPHANUMERIC EXPERIMENT DATA SHEET 


SKILL 
LEVEL 


NWN DNRFRNHONDNMNNMNWNHRNMNNNNNNNM WN NN NM NN EF ND 


ABE. LEi—3 


ay ePcliee 


INTELLIGENCE 


LEVEL 


MmNOW PRN W PERN WPRRNHOWPRHPNOW PEN W PED WwW PPD WD 
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SCENARIO 


NR rR rrr PP SPP SH WWWWWWDNYDNYDODN DNDN RRR RR PR 


TABLE III-3 [CONTINUED] 


RD Aloe 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
1 Z Z 2 -37ce 
Zz 1 3 2 -3480 
3 2 3 3 — 3357) 
4 Z 3 3 -27 
S) 2 Z 4 -243 
6 2 3 + - 3026 
fi 2 3 iL - 26s 
8 2 3 iL — Gans 
) 3 1 3 - 1345 
as Z it es -3)oe 
ll Z Z 4 -l3e8 
IL Z Z 4 -23508 
is: Z il i —- 2555 
14 2 i it -32/2 
IS) 2 2 Z -1494 
16 2 2 Z —-59¢ 
dey Z s 4 -9BG 
18 at 2 4 —-2426 
no 2 = Ih - 3340 
20 3 1 1 -1 7am 
Za 2 4 Z -]l/ ae 
22 Z 2 2 -l2ze 
Ze Z 4 3 - 4740 
24 Z 1 3 —30 a 
2 2 2 Bs - 2360 
Ix) Z 3 2 -4076 
oF i 3 2 - 28m 
28 2 3 3 -§59 
29 2 2 4 —227ae 
30 3 3 1 - 10s 
Se Z 3 IL -18ey 
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TABLE III-3 [CONTINUED] 


TRIAL 3 
SUBJECT SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 
1 y} Ih 3 Or au 
2 1 i 4 15 2 ore 
3 2 2 2 oo > 
+ 2 Z 4 SAS) 
5 2 4 2 i 
6 Z 4 6 AOC, 
a 2 4 3 -1843 
8 2 1 4 =o 
Z S Z i -334 
10 2 3 4 eto 
hal Z 3 i = 20 
2 Zz 3 5 eh) 2 
FS 2 4 2 -1472 
14 B 4 4 -1000 
5 Z 4 1 -489 
16 2 il 4 -1904 
17 Z Zz iL ~1947 
18 Ih 3 2 m2) S) 5) 
Ike, a : Z -1654 
20 3 3 3 -3844 
ZaAk 2 i I =a) eon 
22 Z I 3 ioe 
ZO 2 Z 1 -1494 
24 2 2 Z -1244 
Zo 2 i S sade fh 
26 2 i! 4 —24 50 
ail 1 Z Z = 43) 0)i3) 
Zio 2 2 a. = 2 a0 
Zo Z 4 2 = 2a 
30 3 4 3 -4494 
Si 2 4 3 = 3/54 
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TABLE III~3 [CONTINUED} 


TRIAL 4 
SUBIECL SKILL INTELLIGENCE SCENARIO SCORE 
LEVEL LEVEL 

1 2 4 4 ~i1e0 
2 aL 4 | -327 
3 2 * e -23245 
4 2 i Z -360e 
D 2 ib 3 ~ 5056 
6 Z 1 Z -5465 
7 2 Z 4 -~3Z7 ee 
8 2 2 3 ~30 308 
2 3 4 4 -1014 
10 Z ~ il -338 
dll 2 - B) -947 
eZ 2 il it -23 ay 
is 2 2 4 - 10 
14 2 3 2 ~l6zu 
15 2 3 4 - Js 
16 2 3 dk - 23 
Ay, Z 1 Z ~ 3087 
18 1 1 il —Oae 
19 2 2 3 = 3 Jie 
2) 3 2 2 ~13e% 
jal Z 2 3 ~ Sige 
Za Z 3 i -1/2= 
28 2 3 2 -1694 
24 Z 3 ak -1413 
Zo 2 4 4 - 1208) 
Zo Z 3 é - 39a 
Zui 1 x 4 -1660 
28 Z 1 2 ~53iez 
29 2 1 3 -274= 
30 5 il 2 -13 734 
oul 2 2 4 ~ 156 


* Score reflecting checkmate or checkmate imminent. 
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APPENDIX B 
EXPERIMENT HANDOUT 
SIMULATION EXPERIMENT: GRAPHICS WARGAME USING CHESS MOVES 
PLAYER INSTRUCTIONS 
PURPOSE 


This is a thesis experiment. The experiment is being 
conducted during 084602. This is an experiment in the value 
of military intelligence (information) correlated to the way 
the information is presented. 


OVERVIEW 


All 0OS4602 students and a few additional individuals will 
participate in this experiment. As a participant, you will 
provide approximately three one hour periods of your time. 
At the end of the third hour, you will have played four 
Simulated battlefield scenarios. The four games will be 
completed by the end of the fall quarter of FY85, course 
0S4602. 


The battlefield situations are presented on the WAR Lab 
RAMTEK monitors uSing a graphics display chess board and 
appropriate chess pieces. The game of chess is the medium 
and the chess pieces are the forces employed. The chess 
board is the general battlefield. Think of the various 
chess pieces as maneuver elements. The rules of chess 
describe these maneuver elements, and the capabilities of 
each of the maneuver elements. To help you, the rules of 
chess are attached. 


This experiment is not to evaluate your chess skills per se. 
A level of intelligence information showing which enemy 
elements can be attacked and/or which friendly elements are 
vulnerable to or safe from attack is provided, or is 
missing, With each battlefield situation. 


You are to conduct your campaign one offensive or defensive 
move at a time. After your first move, each subsequent move 
must be accomplished within two minutes after the challenger 
(a computerized chess game) makes its move. 


There are 52 participants and one designated area in the WAR 
Lab for conducting the experiment. Therefore, blocks of 


oF 


time for Lab usage will be scheduled. Enter your name in 
three non-contiguous ‘blocks on the WAR Lab usage board 
(IN-157). 


THE EXPERIMENT 


In order to participate fully in this experiment, you shou 
know the rules of chess (see the attached sheet synopsis). 
In most scenarios, "intelligence" information will be given 
to facilitate your play (moves). 


The display is like the one on the attached rules sheet. 
Moves are made by placing the tablet cursor on the chess 
piece you want to move, indicating your choice to the 
computer by pushing a button on the mouse, moving the tablet 
cursor to the square you want to move to and then indicating 
this to the computer by pushing a button on the mouse again. 
If the move is illegal, the computer will tell you and 
you li have to try again. 


TO PLAY THE GAME 


NCE: The following LOGON, RUN, and monitor selection 
commands shown below are for your information. The umpire 
Will usually accomplish these actions for you. 


Turn on the appropriate RAMTEK monitor and terminal. 
*#**R*k*XENGAGE THE TERMINAL CAPS LOCK KEY***** 
Log on a designated WAR Lab VAX VT100/102. 
User name: CHESS <GR7 
Password: 
At the prompt ($) enter: SDK.GRAPHICS<CR> 
Next, enter: RUNS6MYPLAY <CR> 


After conferring with the umpire, select the appropriate 
monitor (1, 2, or 3) for your game Gisela = 


**k*X**PROM THIS POINT ON, YOU WILL BE PROMPTED FOR INPUT 


The umpire will provide a briefing at the beginning of each 
game. 

After the umpire initializes his terminal, you will be 
prompted for your last name. This is only used “fem 
experiment evaluation identification and will not be 
disseminated. 


98 


Next, you Will be asked your experience level. Please 
respond the same for each of your scenarios. 


When your board display appears, push the reset button on 
your mouse tablet so your cursor will appear if it doesn't 
appear immediately. 


Your first move is not timed so you may somewhat leisurely 
study the “situation” before commencing your campaign. 


Note: All initial set-ups are approximately ten moves into 


a game, the sides are equal in strength, andit is your 
move. 
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APPENDIAWE 
UMPIRE INSTRUCTIONS 
SIMULATION EXPERIMENT: GRAPHICS WARGAME USING CHESS MOVES 
UMPIRE INSTRUCTIONS 
BREESE ENG 


After the game scenario is set up for both the player and 
the umpire, brief the player as follows: 


de The participant will play four games in Color or in 
Monochrome as indicated on the master schedule. 


For two of the games, you will see all the chess 
pieces. Of these two games, one will depict safe areas for 
your pieces and denote enemy pieces you can capture on your 
next move. 


For two of the games, you will see all your pieces and 
only those enemy pieces you can capture on your next move. 
Of these two games, one will depict safe areas for your 
pieces, 


Safe areas are depicted by a small square in the lower 
left corner of a chessboard square. 


A small square in the lower right corner of a 
chessboard square denotes an enemy piece you could cavture 
On your next move, 


Ze The games will not necessarily be played to their 
conclusion. 


Se Caution the player that this 1S a war game and if the 
olayer inadvertently moves to a square already occupied by a 
friendly piece, it can be considered a legal move by the 
computer. This means the player may capture his or ner own 
piece. (This will probably only happen when Monochrome is 
being used and the player forgets which pieces are friendly 
forces 


4. Describe each of the pieces and their appropriate moves 
as required. 


100 


D5 Explain that amove is final and cannot be recalled 
after completion. If the player desires to move a piece 
other than the one initially identified to the computer, the 
player can give the chosen piece an illegal move to cancel 
the order. 


on Show how moves are made with the cursor and explain the 
the use of the menu to castle on the king or queen side. 


le En Passant, an unusual way for one pawn to capture 
another pawn, is not allowed by the computer chess program. 
An En Passant capture is defined as follows: 


A pawn attacking a square crossed by an enemy pawn 
which has been advanced two squares on itsS initial move, may 
capture, but only in the move immediately following the 
enemy pawn's initial move. This is as if the enemy pawn had 
only advanced one square on its initial move. From a 
military standpoint, it is as if the enemy "crossed" a field 
of fire giving you the option of declaring capture or not. 


ce If there are no questions from the player, the first 
game is ready to begin. 


aL, After the first game, display the graphics prior to set 
up of the Chess Challenger to give the player more time to 
study the board prior to the initial move. 


10. After the last game, at the player's terminal, enter 
momero! C <CR>, LO <CR>. 


1 After the last game, at the umpire's terminal, enter 
eomerOl C <CR>, 


DIR<CR> (to check FOROO0O8.DAT;* files) 
SD.<CR> (to return to CHESS) 
COPY [ .GRAPHICS]FORO08.DAT;:* [.FILE]?? (if color) 
[ .GAME]?? (if monochrome) 
SD.<CR> 
SD.GRAPHICS<CR> 
DIR<CR> 
DELETE FORO08.DAT;* 
LO<CR> 


COMPUTER GAME SCENARIO 
Using the master player scenario list: 
igs Determine if the player gets Color or Monochrome 


displays and set-up the player RAMTEK appropriately. TO 
give amonochrome display, disconnect the top (blue) and 


moni 


bottom (red) color cables, leaving monochrome green. NOTE: 
Don't forget to reconnect the cables after the games are 
played. Normal chess white pieces are BLUE and normal chess 
black pieces are RED because the normal cnessboard is black 
and white in these graphics games. 


2. Determine which board set-up the player will receive and 
set-up the Chess Challenger board accordingly. 


36 Determine which intelligence level to present to the 
player. 


4, Turn the player's RAMTEK and terminal on. 


he With the caps key "on", log player on the system as 
follows: 


CHESS<CR> 

(PASSWORD ) <CR> 

SD%.GRAPHICS<CR> 

RUNOMYPLAY<CR> 

(input player monitor number)<CR> 

(player enters his or her last name)<CR> 
(player enters his or her skill level)<CR> 


The player will have a reasonable amount of time to study 
the initial board set-up with no penalty prior to the first 
move. After the first move, each subsequent player move 
must be accomplished within 2 minutes or the player will 
incur a penalty.) 


6. Turn the umpire's RAMTEK and terminal on. 


18 With the caps key "on", log yourself on the system as 
follows: 


CHESS<CR> 

(PASSWORD) <CR> 

SD%.GRAPHICS<CR> 

RUNBMYUMP<CR> 

(input the umpire monitor number)<CR> 

(select intelligence level 1, 3,—5,@0r GHiG@e> 

YE oSCRe 

Y<ER> 

(select canned scenario A, B, C, or D)<CR> 

Y<CR> if the set-up shown is correct of N<CR> Tisnoce 


IO 


CHESS CHALLENGER OPERATIONS: 


After appropriately setting up the Chess Challenger playing 
surface, plug the unit in and give the following sequence of 
commands: 


RE D8 CL 

Rese Cl 

(NOTE: Flashing light for BLACK and solid on light for 
WHITE) 

KING 

QUEEN 

ROOK 

BISHOP 

KNIGHT 

PAWN 

(Recheck piece settings) 

CL 

eee Oly 
Tt is now the player's move. The Chess Challenger will 
produce a "score" if prompted prior to your making BLACK's 
move. If a score is required: 
1. Make BLACK'S move on the tablet. 


Jae Press ST on the Chess Challenger for a four-digit 
hexadecimal code. 


Example: 
4A F3 = BL advantage 
4A.F3 = WH advantage 
3. Enter the code and advantage with the terminal keyboard. 
4, Then, make BLACK'sS move on the Chess Challenger. 
CORRECTION ROUTINE 
If the program blows: 
1. Copy the error message in total. 
Bemecontrol C both terminals. 
After $ prompt, type: 


3. SD.<CR> (takes you back to CHESS) 
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Look for highest number in file FOROO8.DAT;*. 

4. SD%6.THESIS<CR> 

5. DIR<CR> (to Eind FORC0S (DAL ser te 

6. PRINT<CR> 

7. PRINTOFOROO8.DAT;(number seen in directory) /QUEUE=LPA0 


Retrieve orintout and try to run another scenario if 
possible. 
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APPENDIX D 
QUESTIONNAIRE 
Chess Experiment Questionnaire 


Now that you have played your four chess war games, complete 
this questionnaire and return it to the experiment umpire. 


Purpose: 


This questionnaire will assist in quantitative evaluation of 
the Chess Experiment. 


Participant's name: 
Overview: 


You played four chess war game scenarios. Your displays 
were in color, with friendly forces in blue and enemy forces 
in red, or the displays were monochrome green, with no 
apparent differentiation between friendly and enemy forces. 
You began your play after approximately ten moves had been 
made. The chessboard strengths for each side were about 
equal. For some of the scenarios, additional information 
was provided. Also, "perishable", Pageaal ly coded 
information was available because the chess set the umpire 
used announced each of itS moves, using its voice 
synthesizer, and stated the types of pieces involved. 


Chess Experiment: 

Two of the scenarios displayed all the chessboard pieces. 
One of those two games identified your safe moves by placing 
a small square in the lower left corner of the "safe" 
squares. This same scenario identified enemy pieces whicn 
could be attacked by placing a small square in the lower 
right corner of appropriate squares. Indicate below the 
=aweent OF your usage of this additional information: 


Use of additional information: 


(place an "X" as appropriate) 
My net at all 


( ) for a few of my moves 
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( ) for about half of my moves 
( ) for most of my moves 


( ) for all my moves 


Briefly state your rationale for use or non-use of the 
additional information provided: 


Rate your aggressiveness in playing that game using the 
following scale: 


very defensive, non-aggressive play 
somewhat defensive play 

neutral, neither defensive nor offensive 
somewhat offensive play 

very offensive, aggressive play 


in m GNF 
uu nud 


At beginning of game Toward end of game 
( ) C1) 
The other game provided no additional information. 


Rate your aggressiveness in playing that game using the 
following scale: 


1 = very defensive, non-aggressive play 
2 = somewhat defensive play 
3 = neutral, neither defensive nor offensive 
4 = somewhat offensive play 
5 = very offensive, aggressive play 
At beginning of game Toward end of game 


( ) (  ) 


Two of the scenarios displayed your chess pieces and only 
those enemy pieces which could be attacked. 


One of those two games identified your safe moves by placing 
a small square in the lower left corner of the "safe 
squares. Indicate below the extent of your usage of this 
additional information: 
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Hse Of additional infermation: 


(place an "X" as appropriate) 


( 
( 
( 
( 
( 


) 
) 
) 
) 
) 


not 


if: Ors 
fOr 
For 


Lou 


Briefly 
lacie lronal information provided: 


eye ell 

a few of my moves 
about half of my moves 
most of my moves 

all my moves 


State your rationale for use or non-use of the 


Rate your aggressiveness in playing that game using the 
following scale: 


At beginning of game 


Ol & W NF 


( 


very defensive, non-aggressive play 
somewhat defensive play 

neutral, neither defensive nor offensive 
somewhat offensive play 

very offensive, aggressive play 


Toward end of game 


) (  ) 


The other game provided no additional information. 


Rate your aggressiveness in playing that game using the 
following scale: 


al 
2 
3 


very defensive, non-aggressive play 
somewhat defensive play 
neutral, neither defensive nor offensive 


Gy 


4 = somewhat offensive play 
5 = very offensive, aggressive play 
At beginning of game Toward end of game 


(  ) (  ) 


Provide any additional comments concerning the Chess 
Experiment: 
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